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Macroscopic models for spatially extended systems under random in- 
fluences are often described by stochastic partial differential equations 
(SPDEs). Some techniques for understanding solutions of such equations, 
such as estimating correlations, Liapunov exponents and impact of noises, 
are discussed. They are relevant for understanding predictability in spa- 
tially extended systems with model uncertainty, for example, in physics, 
geophysics and biological sciences. The presentation is for a wide audi- 
ence. 
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1 Motivation 

Scientific and engineering systems are often subject to uncertainty or random 
influence. Randomness can have delicate impact on the overall evolution of such 
systems, for example, stochastic bifurcation [8], stochastic resonance [28], and 
noise- induced pattern formation [21]. Taking stochastic effects into account is 
of central importance for the development of mathematical models of complex 
phenomena in engineering and science. 

Macroscopic models for systems with spatial dependence ( "spatially ex- 
tended") are often in the form of partial differential equations (PDEs). Ran- 
domness appears in these models as stochastic forcing, uncertain parameters, 
random sources or inputs, and random boundary conditions (BCs). These mod- 
els arc usually called stochastic partial differential equations (SPDEs). Note 
that SPDEs may also serve as intermediate "mesoscopic" models in some mul- 
tiscale systems. Although we may think that SPDEs could be reduced to large 
systems of stochastic ordinary differential equations (SODEs) in numerical ap- 
proaches [571 [Tj , it is beneficial to work on SPDEs directly when dealing with 
some dynamical issues [i[ni[Il[I3[ini[23[151[Ml[Ml[ini[ni[531[nS|- 

There is a growing recognition of a role for the inclusion of stochastic terms 
in the modeling of complex systems. For example, there has been increasing in- 
terest in mathematical modeling via SPDEs, for the climate system, condensed 
matter physics, materials sciences, mechanical and electrical engineering, and 
finance, to name just a few. The inclusion of stochastic effects has led to interest- 
ing new mathematical problems at the interface of dynamical systems, partial 
differential equations, scientific computing, and probability theory. Problems 
arising in the context of stochastic dynamical modeling have inspired interest- 
ing research topics about, for example, the interaction between noise, nonlin- 
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earity and multiple scales, and about efficient numerical methods for simulating 
random phenomena. 

There has been some promising new development in understanding dynamics 
of SPDEs via invariant manifolds [Ml [T71 [351 HH and stochastic homogeniza- 
tion [S71 [5^. But we will not discuss these issues in this paper. For general 
background on SPDEs, see [H [HI [Ml [THl iH] • 

Although some progress has been made in SPDEs in the past decade, many 
challenges remain and new problems arise in modeling basic mechanisms in 
complex systems under uncertainty. These challenging problems include over- 
all impact of noise, stochastic bifurcation, ergodic theory, invariant manifolds, 
and predictability of dynamical behavior, to name just a few. Solutions for 
these problems will greatly enhance our ability in understanding, quantifying, 
and managing uncertainty and predictability in engineering and science. Break- 
throughs in solving these challenging problems are expected to emerge. 

This article is organized as follows. After reviewing some basic concepts on 
probability in Hilbert space in fj^l we discuss stochastic analysis and SPDEs in 
^ Then we derive correlations of some linear SPDEs, Lyapunov exponents, 
and the impact of uncertainty in 21 iSl and 33 respectively. 

2 Stochastic Tools in Hilbert Space 

2.1 Hilbert space 

Recall that the Euclidean space R" is equipped with the usual metric or distance 

d{x,y) = ^{xj — j/j ) ^ , norm or length ||a;|| = \J^^j=i ; and the usual 

scalar product x-y =< x,y >= ^jVj- The Borel cr— field of R", i.e., S(R") 

is generated by all open balls in R". 

Hilbert space H is a set with three mathematical operations: scalar multi- 
plication, addition and scalar product (•,■), satisfying the usual properties as 
we are familiar with in elementary mathematics. The scalar product induces a 
natural norm = ^JJu~u). The Borel cr— field of H, i.e., B{H) is generated 
by all open balls in H. 

2.2 Probability in Hilbert space 

Given a probability space (f2,JF, P), with sample space 51, ct— field and prob- 
ability measure P. Consider a random variable in Hilbert space H (i.e., taking 
values in H): 

X -.n^ H. 

Its mean or mathematical expectation is defined in terms of the integral with 
respect to the probability measure P: 

E{X) = [ X{uj)dF{Lj). 
Jn 
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Its variance is: 

Var{X) = E{X - E{X), X - E{X)) = E\\X - E{X)f = E||Xjp - \\E{X)\\^ 

Especially, if E(X) = 0, then Var{X) = E\\X\\^. 
Covariancc operator of X is defined as 

Cov{X) ^E[{X -E{X))® {X -E{X))], (1) 

where for any a,b € H, we denote a® b the linear operator in H defined by 

a®b: H^H, (2) 
{a®b)h = a{b,h), he H. (3) 

Let X and Y be two random variables taking values in Hilbert space H. 
The correlation operator of X and Y is defined by 

Cor{X, Y) = E[{X - E{X)) ® {Y - E{Y))]. (4) 

Remark 1. Cov{X) is a symmetric positive and trace-class linear operator with 
trace 

TrCov{X) ^E{X -E{X),X -E{X)) = E\\X - E{X)f. (5) 
Moreover, 

Tr Cor{X,Y) =E{X -E{X),Y -E{Y)). (6) 

2.3 Gaussian random variables 

Recall that a random variable taking values in M" 

X : 

is called Gaussian, if for any a = (ai , • • • , a„) € R" , X -a ~ aiXi • • • + a„X„ is a 
scalar Gaussian random variable. A Gaussian random variable in M" is denoted 
as X ~ N(m, Q), with mean vector m and covariance matrix Q. The covariance 
matrix Q is symmetric and non- negative (i.e., eigenvalue Aj > 0, j = 1, • • • , n). 
The trace of Q is written as Tr{Q) = Ai + • • • + A„. The covariance matrix is 
defined as 

Q = (Q,,) = (E[(X, - m,){Xj - mj)]). 

We use the notations E{X) = m and Cov{X) = Q. The probability density 
function for this Gaussian random variable X in M" is 

where A = Q"^ = (a^fe). 
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The probability distribution function of X is 

F{x) = P(w : X{lu) <x)^ f J{x)dx. (8) 

J —oo 

The probability distribution measure /i (or law Cx) of X is: 

- / f{x)dx, B e B(M"). (9) 

J B 

Here are some observations. For a, 6 £ M", 

72 n n 

E(X, a) = a,Xj = ^ ajE(X,) = ^ a^m, = (m, a) (10) 

■i— 1 i—1 i—1 

){X - m, b)) = E(^ a,{X, - m,) ^ 6j(Xj - m,)) (11) 

i j 

= ^a,5,E[(X, -m,)(Xj-mj)] (12) 
= ^ai^jQij (13) 

= (Qa,6) (14) 

In particular, {Qa,a) = E(X — m,a)^ > 0, which confirms that Q is non- 
negative. Also, {Qa,b) = {a,Qb), which implies that Q is symmetric. 



Definition 1. A random variable X : Q H in Hilbert space H is called a 
Gaussian random variable and denoted as X ^ N(m, Q), if for every a in H , the 
real random variable {X,a) is a scalar Gaussian random variable (i.e., taking 
values in M.^ ). 

Remark 2. If X is a Gaussian random variable taking values in Hilbert space 
H , then for all a,b €z H , 

(i) Mean vector E(X) = m : E(X, a) = (m, a); 

(ii) Govariance operator Cov{X) = Q: E((X — m, a){X — m, b)) = {Qa, b) 

Remark 3. The Borel probability measure fi on {H,B{H)), induced by a Gaus- 
sian random variable X taking values in Hilbert space H , is called a Gaussian 
measure. If fi is a Gaussian measure in H , then there exist an element m £ H 
and a non-negative symmetric continuous linear operator Q: H ^ H such that: 
For all h, /ii, /i2 € H , 

(i) Mean vector m: J^{h, x)dfi{x) ~ {iTi,h); 

(ii) Govariance operatorQ: J^{hi,x){h2,x)diJ.{x) — {m,hi){m,h2) ~ {Qhi,h2) 
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Since the covariance operator Q is non-negative and symmetric, the eigen- 
values of Q are non- negative and the eigenvectors e„'s form an orthonormal 
basis for Hilbert space H: 

QGji — Qn^nt ^ — f ; 2; ' ' ' ■ 

Moreover, trace Tr{Q) = J2'^=i In- 
Note that 

X -m = J2Xnen (15) 
with coefficients Xn = {X — m, e„). 

EXl = E{(X - m, e„) {X - m, e„)) = {Qe„, e„) = (g„e„, e„) = g„. (16) 
Therefore, 

||X-m|p = ^X2 (17) 



El|X-mj|2 = ^EX2 = ^9„ = Tr(Q). (18) 

We use £^(ri, H), or just £^(^1), to denote the (new) Hilbert space of square- 
integrable random variables x : ^ H. In Hilbert space L^{n,H), the scalar 
product is 

<x,y>=E< x{uj),y{uj) >, 

where E denotes the mathematical expectation (or mean) with respect to prob- 
ability P. This scalar product induces the usual mean square norm 

which provides an appropriate convergence concept. 
2.4 Brownian motion 

Recall that a Brownian motion (or Wiener process) W{t), also denoted as Wt, in 
i?", is a Gaussian stochastic process on a underlying probability space {fl, T, P), 
where J7 is a sample space, J- is a cr— field composed of measurable subsets of 
J7 (called "events"), and P is a probability (also called probability measure). 
Being a Gaussian process, Wt is characterized by its mean vector (taking to be 
the zero vector) and its covariance operator, a nx n symmetric positive definite 
matrix (taking to be the identity matrix). More specifically, Wt satisfies the 
following conditions [H]: 

(a) W(0)=0, a.s. 

(b) W has continuous paths or trajectories, a.s. 

(c) W has independent increments, 

(d) W(t)-W(s) N{0, [t - s)I), t and s > and t > s > 0, where / is the 
n X n identity matrix. The Brownian motion in is called a scalar Brownian 
motion. 
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Remark 4. (i) The covariance operator here is a constant nxn identity matrix 
I, i.e., Q ~ I and Tr{Q) = n. 

(ii) W{t) ~ N{Q,tI), i.e., W{t) has probability density function ptix) = 



(Hi) For every a S (0, i), for a.e. lo ^il, there exists C{uj) such that 

\W{t,Lu)~W{s,oj)\ < C(tj)|i-s|", 
namely, Brownian paths are Holder continuous with exponent less than one half. 

Note that the generalized time derivative of Brownian motion Wt is a math- 
ematical model for white noise [3]. 

Now we define Wiener process, or Brownian motion, in Hilbert space U . 
We consider a symmetric nonnegative linear operator Q in U . If the trace 
Tr{Q) < +00, we say Q is a trace class (or nuclear) operator. Then there exists 
a complete orthonormal system (eigenfunctions) {ck} in U , and a (bounded) 
sequence of nonnegative real numbers (eigenvalues) qk such that 

Qek = qkSk , /c = 1,2, • • • . 

A stochastic process W{t), or Wt, taking values in J7 for i > , is called a 
Wiener process with covariance operator Q if : 

(a) wlo) = 0, a.s. 

(b) W has continuous trajectories, a.s. 

(c) W has independent increments, 

(d) W(t) ~ W{s) - N(0,(t-s)Q), t > s. 
Hence, EW{0) = and Cov{wlt)) = tQ. 

We can think the covariance matrix Q as a cx) x cx) diagonal matrix, with 
diagonal elements qi.q2, - ■ ■ , • • ■ • 
For any a H, 

a = ^ < a, e,i > e„ 

n 

Qa = ^ < a, e„ > Qe^ = ^ g„ < a, e„ > e„ 

n n 

We define, for 7 > 0, especially for 7 € (0, 1), 

Q'^a = ^q7i < a, e„ > e„, (19) 

n 

when the right hand side is defined. 

Representations of Brownian motion in Hilbert space: 

It is known that Wt has an infinite series representation |13| : 

00 
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where 



W^{t):={ , 9n>U: (21) 

, fl„ = 0. 



are the standard scalar independent Brownian motions. Namely, Wn{t) ~ 
N(0,i), EW„(i) = 0, EWn{t)^ = t and EW„(i)W„(s) = min(t,s). 

This infinite series converges in L'^{n), as long as Tr{Q) ~ < oo. 

Remark 5. For example in H ~ L^{0, 1), we have an orthonormal basis e„ = 
sin(n7ra;) . In the above infinite series representation, taking derivative with 
respect to x, we get 

oo 

cos{mTx). (22) 

Tl=l 

In order for this series to converge, we need ^/2{mT)y/q^ converges to zero suf- 
ficiently fast as n oo. So qn being small helps. In this sense, the trace 
Tr{Q) = ^ Qn may be seen as a measurement for spatial regularity of white 
noise Wt: the smaller the trace Tr{Q), the more regular of the noise. 



We do some calculations. For a,b e H, we have the following identities. 

oo oo 

E{Wt,Wt) = E\\Wtf = EiY, VQ^^Wn{t)en, V^W„(t)e„) 

n— 1 n— 1 

oo 

= ;^9„E(w^„(t),w^„(t)) 

oo 

= tY,qn^tTr{Q). (23) 



E{Wt,a) = (0,a)=0. (24) 
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Ei{Wt,a) {Wt,b)) = E[{J2^Wnit)en,a) {J2V^Wn{t)er„b)] 

71—1 n—1 
m.n 

= tqn < en, g >< en, b > 

n 

= < Cn, a >< gnen, b > 

n 

= ty^ < en, a >< Qen, b > 

n 

= ty^ <Q< en, a > en, b > 

n 

= t < Qy^ < en, a > en, b > 

n 

= t<Qa,b>, 

where we have used the fact that a — < en, a > e„ in the final step. 
In particular, taking a = fe, we obtain 

E(Wt,a)2 ^ t{Qa,a), (25) 
Var{{Wt,a)) = t{Qa,a). (26) 

More generally, 

E((Wt,a) {Ws, b)) ^ miii{t, s) < Qa,b > . (27) 

Moreover, 

oo oo 

E[Wt{x)Ws{y)] = E{^y^VFn(i)e„(x) ^ V^W™(s)e™(y)} 

n—1 m— 1 

oo 

= X! V?"?™ E[Wn{t)W,n{s)]en{x)em{y) 
n,m— 1 

oo 

= min(i, s)^g„e„(x)e„(?/) 

^ min{t,s)q{x,y), (28) 

where 

oo 

Qix,y) ^^qnenix)eniy). 

n=l 



9 



On the other hand, the covariance operator may be represented in terms of 
Qa = < e„,a > e„ = ^<e„,a>Qe„ 

n n 

= ^ < e„, a > g„e„ 

n 

= y2 a{y)e„{y)dyqnen{x) 

n -'O 
1 

q{x,y)a{y)dy. (29) 







Somctmies we call the kernel function q{x,y) the spatial correlation. The 
smoothness of q{x, y) depends on the decaying property of ^n's. 

3 Stochastic Partial Differential Equations 

3.1 Stochastic calculus in Hilbert space 

We define the Ito stochastic integral: 



<^{s,uj)dWs. 

Note that since Wt takes values in Hilbert space U. The integrand (f>(t,a;) is 
usually a linear operator from U to H (for each time t and each sample oj): 

It is also possible to take Wt as a scalar, real-valued Brownian motion. For 
example, in u{s)dWs, if Wt is a scalar Brownian motion, we can interpret 
the integrand u as a multiplication operator. 
For Brownian motion Wt in U 

oo 

Wt(w) = ^V9^W^„(t)e„, (30) 

71 = 1 

we define 

/ ^s,Lu)dWs{u;) = Y.V^ ^s,uj)endWn{s). (31) 
Jo ^0 

A property of Ito integrals: 

E / $(s,w)dW^,(w) = 0. (32) 
Jo 
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3.2 Deterministic calculus in Hilbert space 

In order to discuss more tools to handle stochastic calculus in Hilbert space, we 
need to recall some concepts of deterministic calculus. 

For calculus in Euclidean space K", we have concepts derivative and direc- 
tional derivative. In Hilbert space, we have the corresponding Frechet derivative 
and Gateaux derivative [H [64] . 

Let H and H be two Hilbert spaces, and F : U <Z H ^ H he & map, whose 
domain of definition U is an open subset of H . Let L{H, H) be the set of all 
bounded linear operators A : H ^ H. In particular, L{H) := L{H, H). We can 
also introduce a multilinear operator Ai : H x H ^ H. The space of all these 
multilinear operators is denoted as L{H x H, H). 

Definition 2. The map F is Frechet differentiable atuQ G U if there is a linear 
bounded operator A : H ^ H such that 

hm muo + h)- FM-Ah\\ ^ ^^^^^ ^ _ _ ^ 

h^O 1 1 ft I 

where || • || denotes norms in H or H as appropriate. The linear bounded operator 
A is called the Frechet derivative of F at uq, and is denoted as Fu{uo), or 
sometimes F'{uq). 

If F is linear, its Frechet derivative is itself. 

Definition 3. The directional derivative of F at uq ^ U in the direction h Cz H 
is defined by the limit 

6Fiuo;h) .,^,^n-o+th)-nuo)^ 

If this limit exists for every h € H , and _F'q(uo)/i := SF(uo', h) is a linear map, 
then we say that F is Gateaux differentiable at uq. The linear map Fq^uq) is 
called the Gateaux derivative of F at uq. 

In fact, if F is Frechet differentiable at uq, then it is also Gateaux differen- 
tiable at Uq and they are equal [H [64] : 

Fu{uo) = i^cK). 

But the converse is not usually true. It is true under suitable conditions; see 
[1], p. 68. 

For any nonlinear map F : U C H ^ Y, its Frechet derivative F'{uo) is a 
linear operator, i.e., F'{uo) £ L{H,Y). Similarly, we can define higher order 
Frechet derivatives. Each of these derivatives is a multilinear operator. For 
example, 

f"{uo) : HxH^Y, 

{h,k) '^ f"{uo){h, k). 
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We denote 

r{uo)h^ f"{uo){h,h), 
f"'iuo)h^ f"'iuo)ih,h,h), 

and similarly for higher order derivatives. 

Then we have the Taylor expansion in Hilbert space 

fiu + h)^ fiu) + fiu)h + + • • • + + Rm+i{u, h), 

where the remainder 

R.,+i{u,h) = , ] f\l - srf"'+^\u + sh)h"'+^ds. 
(m + 1)! Jo 



Remark 6. It is interesting to relate these two concepts with the classical con- 
cept of variational derivative (or functional derivative) that is used in the con- 
text of calculus of variations. The variational derivative is usually considered 
for functionals defined as spatial integrals, such as a Langrange functional in 
mechanics. For example, 

F{u) ^ I G{u{x),Ux{x))dx, 
Jo 

where u is defined on x ^ [0, 1] and satisfies zero Dirichlet boundary condition 
at X — 0,1. Then it is known \27l that 

5F 

Fu{u)h= / —h{x)dx, (33) 
Jo on 

for h in the Hilbert space Hq{0,1). The quantity ^ is the classical variational 
derivative of F. The equation I133\} above gives the relation between Frechet 
derivative and variational derivative. 

3.3 Ito's formula in Hilbert space 

We get back to stochastic calculus in Hilbert space H. We first look at the Ito's 
formula; see [13] or [48] , 

Theorem 1. Let u be the solution of the SPDE 

du = b{u)dt + •i>{u)dWt, u(0) = uq. (34) 
Assume that F{t,u) be a given smooth (deterministic) function: 

F -.[0,00) X H ^ R\ 
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Then 

(i) Ito's Formula: Differential form 

dF{t,u{t)) = F^{t,u{t)){<^{u{t))dWt) 

+ {Ft{t,u{t)) + Fu{t,u{t))[h{u{t)) 

+ iTr[i^„„(i,«(0)($(uW)Q^) ('i>(wW)Q^)1}rfi, (35) 

where _F„ and F^u 0'i"e Frechet derivatives, Ft is the usual partial derivative 
in time, and * denotes adjoint operator. This formula is understood with the 
following symbolic operations in mind: 

{dt, dWt) = {dt, dWt) = 0, {dWt.dWt) = Tr{Q)dt 

(ii) Ito's Formula: Integral form 

F{t,u{t)) = F(0,«(0))+ / F^{s,uis))muis))dWs) 

+ I {Ft{s,u{s)) + Fu{s,u{s)){b{u{s)) 
Jo 

+ ^Tr[FUs,uis))mu{s))Q-^)mu{s))Q^r]}ds, (36) 

where F^ and F^u are Frechet derivatives, and Ft is the usual partial derivative 
in time. Moreover, 

F^{s,u{s)){Hu{s))dWs)^ / ^{u{s))dWs 
Jo 

and for all s, w G H , uj £ ^l, the operator $(it(s)) is defined by 
Hu{s))iv) := Fu{s,uis))mu{s))v). 

Also, 

Tr[Fuu{s,u{s))mu{s))Qi) {<f{u{s))Qiy] = Tr[mu{s))Q--y Fuu{s,u{s)) ($(«(.s))Q^)]. 

Note that for the symmetric non-negative covariance operator Q with eigen- 
values g„ > and eigenvector e„, n = 1, 2, • • • , we have 

= ^ g„(ti, e„)e„, Q^u = ^ qrl {u, e„)e„. 

n n 

In fact, for a given function /i : R ^ M, we define the operator h{Q) through 
the foUowing natural formula ([53], P- 293-294), 

h{A)u = ^ h{qn)(u, e„)e„, 

n 

when the right hand side is defined. 
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Example 1. A typical application of Ito's formula for SPDEs. 



du = b{u)dt + ^{u)dWt, u(0) = uq. (37) 

Take Hilbert space H = L^{D),D C M", with the usual scalar product {u,v) = 
uvdx. 

Energy functional F{u) ~ ^Jj^u^dx = In this case, Fu{u){h) = 

JjjUhdx and Fuu{u)[h^k) = ^ j^h{x)k{x)dx. 

^d\\uf = {{uMn)) + \Tr j^[{^{u)Q--){^{u)Q"^Y]dx}dt + {u,^{u)dWt), 
Integrating and taking mathematical expectation, we obtain 

-Muf = -E||u(0)f + E / {u,b{u))dt+-E [ Tr [ [{<S>{u{r))Q^)mu{r))Q^^y]dxdr 

Note that in this special case, is a bounded operator in L{H,M.), which 
can be identified with H itself due to the Riesz representation theorem. 

Example 2. Energy functional F{u) = Jjj \u\'^Pdx = Jjj{\u\'^ydx for p G 
[l,oo). In this case, Fu(uo){h) = 2p Jjj\uo\'^P~^uohdx and Fuu{ui)){h,k) = 
2p \uo\^P-^hkdx + Ap{p - 1) \uo\^P-^uoh{x)uok{x)dx. 

Example 3. (HSIj P- 153) Let H be a Hilbert space with scalar product < •, • > 
and norm \\ ■ |p =< •, • >. 

Consider an energy functional F(u) = for p G [l,oo). In this case, 

Fu{uo){h) = 2p||uo|pP"^ <uo,h> and 

Fuu{u(i){h,k) = 2p||uo||2P"2 <h,k> +4p(p- 1)||mo||^^"'* <uo,h> <uo,k> 
^ 2p\\uo\\'^P-'^ <h,k> +Ap{p - l)||woir^"'' < ("0 «) uo)h, k >, 

where {a (g) b)h := a <b,h >; see g| or fl^ . p25. 

Stochastic product rule: 

Let u and v be solutions of two SPDEs. Then 

d{uv) = udv + {du)v + dudv. (38) 

Ito isometry: 

E|| / ^it,uj)dWtf =E Tr[($(r)Q^)($(r)gl)*]dr. (39) 
Jo Jo 

Generalized Ito isometry: 
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E( / F{t,uj)dWt, / G{t,iu)dWt) 
Jo Jo 

= E Tr[{G{r,uj)Qi){F{r,uj)Q-^y]dr, (40) 
Jo 

where a Ab ~ min(a, b). 

3.4 Stochastic partial differential equations 

A general class of SPDEs may be written as 

dut = [Au + f{u)]dt + G{u)dWt, (41) 

where Au is the linear part, f(u) is the nonlinear part, G{u) the noise intensity 
(usually an operator), and Wt a Brownian motion. When G depends on u, 
G{u)dWt is called a multiplicative noise, otherwise it is an additive noise. 

For general background on SPDEs, such as wellposedness and basic proper- 
ties of solutions, see [13l |48l El] . 

4 Correlation 

In this section, we discuss correlation of solutions, at different time instants, of 
some linear SPDEs. We first recall some information about Fourier series in 
Hilbert space. 



4.1 Hilbert-Schmidt theory and Fourier series in Hilbert 
space 

A separable Hilbert space H has a countable orthonormal basis {e„}5^j . Namely, 
(emjCn) = 5mn, wherc 5mn IS the Kronecker delta function. Moreover, for any 
h S H, we have Fourier series expansion 

oo 

/i = ^(/i,e„)e„. (42) 

n=l 

In the context of solving stochastic PDEs, we may chose to work on a Hilbert 
space with an appropriate orthonormal basis. This is naturally possible with 
the help of the Hilbert-Schmidt theory [63], p. 232. 

The Hilbert-Schmidt theorem ([63], p. 232) says that a linear compact sym- 
metric operator A on a separable Hilbert space H has a set of eigenvectors that 
form a complete orthonormal basis for H . Moreover, all the eigenvalues of A 
are real, each non-zero eigenvalue has finite multiplicity, and two eigenvectors 
that correspond to different eigenvalues are orthogonal. 
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This theorem applies to a strong (self-adjoint) elliptic differential operator 

B 

Bu^ {-l)\°'\D''{ao,p{x)D'^u), a; £ £> C M", 

0<|Q|,|/3|<m 

where the domain of definition of B is an appropriate dense subspace oi H = 
L^{D), depending on the boundary condition specified for u{x). 

In this case, A := B^^ is a linear symmetric compact operator in a Hilbert 
space, e.g., H = L^{D). We may consider (L + al)~^. This may be necessary 
in order for the operator to be invertible, i.e., no zero eigenvalue, such as in the 
case of Laplace operator with zero Neumann boundary condition. 

By the Hilbcrt-Schmidt theorem, eigenvectors (also called eigcnfunctions in 
this context) oi A — B~^ form an orthonormal basis for H — L?{D). Note that 
A and B share the same set of eigenfunctions. So we can claim that the strong 
elliptic operator B's eigenfunctions form an orthonormal basis for H = L^{D). 

In the case of one spatial variable, the elliptic differential operator is the so 
called Sturm-Liouville operator p. 245. For example 

Bu = -{pu'Y + qu, X e (0, 

where p{x), p' (x) and q{x) are continuous on (0,1). This operator arises in 
the method of separating variables for solving linear (deterministic) partial 
differential equations in the next section. By the Hilbert-Schmidt theorem, 
eigenfunctions of the Sturm-Liouville operator form an orthonormal basis for 
= L2(0,/). 

4.2 The wave equation with additive noise 

Consider the stochastic wave equation with additive noise: 

utt = c^u^x + fWu 0<x <l, t>0 (43) 
u{0,t) ^ u{l,t) ^0, (44) 
uix,0) = f{x), utix,0)^gix), (45) 

where e is a real parameter modeling the noise intensity, c > is a constant 
(wave speed), and Wt is a Brownian motion taking values in Hilbert space 
H = L^{0,1). 

Method of cigcnfunction expansion: 

oo 

w = ^ u„(t)e„(x), (46) 

ri=l 

oo 

Tl = l 

where 

en{x) = ^/2/l sin — — , A„ = {mr/l)'^,n = 1, 2, • • • . 



16 



Putting these into the SPDE uu = c^u^^ + eWtwc obtain 

Unit) + C^XnUn = e^^Wnit), n = 0, 1, 2, • • • . (48) 

For each ??, this second order SDE may be solved by converting to a hnear 
system of first order SDEs [41]: 

I CTITT CT17T 

Unit) = [An-e V9« / sin— —s(iW,i(s)] COS— 

cnn Jo I I 

I (^fl'jY CTlTT 

+ [Bn + e ^/ COS— sdW„(s)] sin— t (49) 

criTT Jq I I 

with An and Bn constants. 
The final solution is 

u[x,t) = } {[An-e vg^ / sm— — sdH/„(s) COS— — t 

n=l 

I CTITT CTITT 

+ [Bn+e yM'i COS— —sdM^„(s)] sin— —i}e„(a;), (50) 

cniT Jq I I 

where the constants An and i?„ are determined by the initial condition as follows 

An = {f,en), Bn = —{g,en). 

cmr 

When the noise is at one mode, say at the first mode ei(x) (i.e., qi > but 
(7,1 = 0, n = 2, 3, • • • .), we see that the solution contains randomness only at 
that mode. So for the linear stochastic diffusion system, there is no interactions 
between modes. In other words, if we randomly force a few fast modes, then 
there is no impact on slow modes. 

Mean value for the solution: 



„ , , V A r , , CTlTTt^ , ^ , CTlTTt , _ , , , 

Euix,t) = ^[yl„cos(— p) + B„sm(— p)]e„(a;). (51) 

n— 1 

Covariance for the solution: 

Now wc calculate the covariance of solution u at different time instants t and 
s, i.e., E < uix, i) — Em(x, t),uix, s) — Em(x, s) >. 
Using the Ito's isometry, we get 

E < uix, t) — Eu(x, i), uix, s) — Eu(a;, s) > 

oo 9j9 />tAs I 

e L Qn r 9 cmrr cmrt cmrs 

sm — ; — dr cos — ; — cos — ; — 



n— 1 







2 cmrr . cmrt . cmrs 
cos — J — dr sm — j — sm — j — 

''^^^ cmrr cmrr , , cmrt , cmrs cmrs . cmrt ^ 







sm - 



cos — - — (ir(cos — ; — sin — ; h cos — - — sin - 



10 



I I 
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After integrations, we get the covariance as 

Cov(u(x,t),u{x, s)) = K < u{x,t) —lLu(x,t),u{x, s) — Eiu{x, 

e^pQn ,, , cmrit — s) 



n=l 



I 2cn'K(t A s) crnrU + s) 

Sm : cos : 



2cmr 



I 2cmr{t A s) . cmr{t + s) 
cos ; sm ; 



2cmT 



I cwkU + s) 
■ sin ; 



2cmT 

n— 1 

I cmr(t + s - 2(t A s)) 
sm ; 



2cmr 



I cwkU + s) , 

■ sm ■ ' 



2cmT I 
In particular, for t = s we get the variance. 

Variance for the solution: 

n— 1 

Energy evolution for the solution: 

2'' 

Taking time derivative, 







E{t) ^ / ut[utt - c'^Uxx]dx = e ut{x,t)Wt(x)dx. 

JQ Jo 

Or in integral form, 

E{t) = E{0) + e I I Us{x,t)dWs{x)dx 
Ja Jo 

= E{0) + e [ [ dtu{x,s)dWsix)dx 
Jo Jo 

Thus 

EE{t) = E{0). 
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Var{E{t)) = E { [ [ dtu{x, s)dWsdx)'^ , (56) 
Jo Jo 

where Wt is in the foUowing form 

oo 

Wt = W{t) ^ ^ V9^W„(i)e„(a:), (57) 

n=l 

and dfU can be written as 

■r-^ cm: cmrt crnr cmrt 

OtU = Z_,{-Ari—j-Sl\l— h-Bn— ^COS— ^ 

CWKt 



CTITTS CTiiri 

sin dWn{s) sin — ^ 



[* criTTS , , cnnt.. . . 
+ / cos— —dW,i(s) cos— —]} e„(x). (58) 
Jo ' ' 

Set ~ fin and rewrite 

dtu = y^^{F„{t) + e^/q^[ / (sinju„s • sin^„t + cos^„s • cos,u„t)(iW^„(s)]}e„(a::) 

= ^{Fn{t) + ^Vq^ J COS Unit ~ s)dWn{s)}enix), 

where 

F„(i) := -AiMri sin^„i + B„/i„ cos/x„t, n = 1, 2, • • • 
For the simphcity of notations, set 

Gn{t) := Fnit) + / COS iJ,n{t - s)dW„{s), n = 1,2, • • • 







then we have 

dtu = ^ G„(i)e„(x) 

Thus 



E{ dtu{x,s)dWsdxf = E[/ C^V^enix) u,dWn{s))dx]^ 

Jo Jo Jo n=l 

oo A „t 

= EiY^^J / Usen{x)dWn{s)dxf 

= E[Y^^ (/ en{x)Y,Gj{s)ej{x)dx)dWn{s)f 

oo „t oo 

= E[VV^/ C>2G,{s) en{x)e,{x)dx)dWn{s)\' 

n=l j = l 

oo „t 
= E[V ^ / Gn{s)dWn{s)f 
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J2qnE Gl{s)ds 

y^qnE [Fn{s)+e^ COS Hn{s-r)dWn{r)]'^ds 

n=l Jo Jo 

OO oo pi pg 

J2l^ ^'(sK^ + Ej^e'gf, / [/ cos/i„(s-r)dW„(r)]2ds 

n=l Jo ^0 ^0 

oo /.* oo „t „s 

Vg„ / F2(s)ds + Ve^?^ / [/ cosV«(s-r)dr]ds 
n=i -^0 Jo Jo 

°° t 1 t I 



1 °° <2 1 

- -A„B„^„(1 - cos2^„i)] + ^ £^<ll[j + 3-^(1 " cos2//„i)]. 

n=l 

Therefore, 



t 1 t 1 

Var{E{t)) = Y,^^qn[Alpl{- ^ — sm2fint) + Blfil{- + —sm2fint) 

71—1 

1 t'^ 1 

- :jAiS„/i„(l - cos2nnt)] + ^ e'*9«[-r + ~ cos2^„t)]. 

4.3 The diffusion equation with muhiphcative noise 

Consider the stochastic Diffusion equations with zero Dirichlet boundary con- 
dition 

ut = + euwt, < X < 1, (59) 
u{x,0) = fix), (60) 

where Wt is a scalar Brownian motion. We take Hilbert space H = L^{0, 1) with 
an orthonormal basis e,i = \/2sm{mrx). We use the method of eigenfunction 
expansion: 

w(.T,t) = ^u„(i)e„(x), (61) 

Uxx = ^w„(t)e„(x) = ^ -Un{t)imr)'^e„{x). (62) 
Putting these into the above SPDE ((59)) . with A„ = (n7r)^, we get 

^M„(t)e„(a;) = ^ u„(t)(-A„)e„ + u„(t)e„(a;)ii;t. (63) 
We further obtain the following system of SODEs: 

du„(t) = -XnU„{t) + eun{t)dw{t), 71 = 1, 2, 3, • • • . (64) 
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Thus ^ 

Un{t) = u„(0) cxp((-A„ - + ew{t)), (65) 

where uq = Y, < uq, e„(a;) > e„(a;). Therefore, the final solution is: 

u{x, ^) = ^ ane„(x) exp(&„t + eiut), (66) 

with a„ =< /(x),e„(x) > and 6„ = (-A„ - ie^). 

Note that Ecxp(&„t + eift) = exp(6„t)Eexp(eu't) = exp(6„t) exp(ie^t) = 
exp(— A„t). Therefore, we can find out the mean, variance, covariance and 
correlation of the solution: 

E{u{x, t)) = ^ a„e„(a;) exp(-A„t). (67) 



Var{u{x, t)) = E(w(x, t) - E{u{x, t)), u{x, t) ~ E{u{x, t))) 

= ^al exp(-2A„t) [cxp{e^t) ~ 1] . (68) 



For T < t, we have 



Ecxp{e(u't + t«r)} = Eexp{e(wt — Wi-) + 2ewT-} 

= Eexp{e(z«( — Wi-)} ■ Eexp{2ei(jT-} 

= cxp{ie2(i - t)} • exp{2eV} 
= cxp{^e^[{t + T)+2{tAT)]}. 
therefore, by direct calculation, we can get 

Cov{u{x, t), u{x, t)) = J2 ali^Mbnit + r) + ^^{{1 + t) + 2{t A r))) + exp(-A„(t + r)) 
- exp(-A„r + bnt + ^e^i) - exp(-A„t + 6„t + ^e^^)} 
= ^ al cxp{-A„(t + r)}[exp{e2(i a r)} - 1] 

and 

Corr{u{x, t), u{x, t)) 

Cov(u(x, t), u{x, t)) 



y^Var(u(x, t)) y^Var(u{x, t)) 

E exp{-A„(t + T)}[exp{e^t A r)} - 1] 



v/E«?.cxp(-2A„i)[exp(e2t) - 1] a2 exp(-2A„r)[exp(e2T) - 1] 

5 Lyapunov Exponents 

Lyapunov exponents are tools for quantifying growth or decay of linear systems 
(e.g., PDEs or SPDEs). The following discussions are from [7115^. 
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5.1 A deterministic PDE system 

Let us first look at the following deterministic PDE: 

du 

-g^ =Uo,x + au, (69) 

u{Q,x) = S[x), (70) 

u{t,x) ^Q, xedD (71) 

where D = {a; : < a; < 1} and the function / S i^(0, 1). An orthonormal basis 
for L^(0, 1) is {e„(a:)}, n = 0, 1, 2, . . . , dxx^j = —^j^j,- Note that < t oo- 
We then can write: 



f ^^fjGj, where fj = (/, ( 



(72) 



By using the method of eigenfunction expansion, it is known that the unique 
solution to the problem is given below: 



L{t,x) = exp(f (— Aj + a))fjej[x), t>Q. 



(73) 



Theorem 2. Let us fix an initial condition /, / 7^ 0. Let jq be the smallest 
integer j > in the expansion (|72p of f such that fj,^ 7^ 0. Then the Lyapunov 
exponent of the system (|69p — (j71[) exists as a limit and is given by 

A"(/) = -A,„+«. (74) 

Proof. For a class of initial conditions / we calculate the Lyapunov exponents, 
which are defined as 



A"(/) = limsupilogi|^i(t)||i. 

t — ^00 



(75) 



By applying (j73p . we obtain the Lyapunov exponents regarding to PDE 
system - (|7T|) . 



A"(/) = hmsup - log 

t— >oo t 



^exp(t(-Aj + a))fjej{x) 



(76) 



On the one hand. 



^exp(t(-Aj + a))fjej{x) 
3=0 



< ilog|^f;|exp(i(-A,„+a))/,f j 



1/2 



-Xj„ +a + jlogil/ 



(77) 
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On the other hand, 
1 



t 



log 



> - log I exp(t(-Aj_o + a))fjo I 



-Ajo +a + - log|/jJ 



(78) 
□ 



5.2 A SPDE system 

We now consider the foUowing SPDE 

dv — {vxx + I3v)dt + 7w dwt, 

v{0,x,Lo) = f(x),x G D 
v{t,x,uj) = 0, a; e dD, 



(79) 

(80) 
(81) 



where Wt is a scalar Brownian motion. The conditions ([80]) and (|8ip hold for a. 
a. w G ri. 

We seek the solution with expansion with respect to the basis {cj} (see the 
last subsection) 



Kt,x) =Yy.j{t)ej{x), 



(82) 



where yj{t), for j = 0, 1, 2, . . . satisfy the following stochastic ordinary differen- 
tial equations: 



So 



dy]{t) = + I3)yj{t)dt + ^yj{t)dwt, 

yj{t) = exp(7Wt) exp ^ ^-A^ +(3- ^7^^ ?j fj. 



Thus from (|82p . we obtain, 



a;) = ^ exp(7'u;t) exp ^ ^-A^ + /3 - ^7^^ /jCj. 



Observe that 



w(t, x) = exp(7W() exp (((/?- a) ) t ] u{t, x), 



(83) 



(84) 



(85) 



(86) 



where u{t, x) is the solution to the above deterministic PDE ((69)) - (|7T|) 
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By , we can calculate the Lyapunov exponent of the stochastic system 
(|79|) — ((8T|) as a function of the Lyapunov exponent of the deterministic system 
dSni) - (EH) as follows: 



yif) 



lim sup — log ||v(i)| 

t — ^oo t 



lim sup — log 

t — ^oo t 



cxp(7Wt) exp 
= A"(/) + (/3-a)-i72, a.5 



(87) 



by the strong law of large number. 

Let us state the result in the following theorem. 

Theorem 3. Let f ^0. Then the Lyapunov exponent of the SPDE ^ - ((gT|) 
almost surely exists as a limit, is non-random and is given in the following 
formula: 

(88) 



A"(/) = A"(/) + (/3-a)-i7^ a.s. 



Remark 7. Let us consider a special case when a = /3. Then by the above 
theorem, for a fixed initial condition f , the Lyapunov exponent of the stochastic 
system ^ - ^ is 

1 



A"(/) = A"(/)--7^ 



(89) 



which obviously is smaller than the Lyapunov exponent of the corresponding 
deterministic system (|69[) — (|7ip . The result implies that this stochastically per- 
turbed system is more stable than the original deterministic system. 



6 Impact of Uncertainty 

In this section, we first recall some inequalities for estimating solutions of 
SPDEs, and then we estimate the impact of noises on solutions of the non- 
linear Burgers equation. 



6.1 Differential and integral inequalities 

Gronwall inequality: Differential form [SS] 

Assuming that y{t) > 0, g(t) and h{t) are integrable, if || < g{t)y-\-h{t) for 
t >tQ, then 

2/(0<y(io)e^'c^^"^'^+ A(s)[e/>M'^^ds, t>to. 

Jto 

In particular, ii ^ < gy + h for t > to with g, h being constants and to ~ 0, 
we have 

y(i)<2/(0)e»*--(l-e»*), t>0. 
9 
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Note that when constant g < 0, then hnit_,oo y{t) ^ ■ 
Gronwall inequality: Integral form [TTl [21] 

If u{t),v{t) and c{t) are all non-negative, c{t) is differentiable, and v{t) < 
c{t) + u{s)v{s)ds for t > to, then 

< «(to)e^'« + rc'(s)[e/>M'^^ds, i > io- 

J to 

In particular, assuming that > and is continuous and y{t) < C + 
K y{s)ds, with C,K being positive constants, for t > 0. Then 

y{t) < Ce''^\ t > 0. 
6.2 Sobolev inequalities 

We first introduce some common Sobolev spaces. For fc = 1, 2, • • • , we define 

HHOJ) /,/',••• J^"^ eL'{0,l)} 

Each of these is a Hilbert spaces with the scalar product 

{u, v)k = [ [uv + u'v' H h u^'''>v^''^]dx, 

Jo 

and the norm 

For fc = 1, 2, • • • and p> 1, we further define another class of Sobolev spaces 
W^^^{D) ^{u: u,Du,-- - , D°'u e LP{D), \a\ < fc}, 

with norm 

\\uh.p = {\\u\\i, + \\urL. + --- + \\u^'^rL.)'- 

Moreover, Hq{0,1) denotes the closure of C^{0,1) in H'^{0,1) (i.e., under the 
norm || • ||fc). It is a sub-Hilbert space in H^{QJ). Similarly, W^q (0^ denotes 
the closure of C^(0, Z) in I4^'^'P(0, Z) (i.e., under the norm || • ||a;,p)- It is a 
sub-Hilbert space in W^^^lS),!). 

Standard abbreviations = L'^{D), = Hq{D), fc = 1, 2, . . ., are used for 
the common Sobolev spaces in fluid mechanics, with < •, • > and j| • || denoting 
the usual (spatial) scalar product and norm, respectively, in L'^(D): 

<f,g>-^J fgdxdy, Will ■■= \/< fJ > ^ ]j J .f{x,y)dxdy. 
Cauchy-Schwarz inequality: 
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In the space L'^{D) of square-integrable functions defined on a domain D C 



f{x)g{x)dx\ < y J^p{x)dx ^ J^cfix)dx. 
Holder inequality: 

In tlic space U{D) of functions defined on a domain D C R": 
f{x)g{x)dx\ < ( / \f{x)Y>dxY^ ( / 

D JD JD 

Minkowski inequality: 

In tlic space L'p{D) of functions defined on a domain D C M": 



\f{x)±g{x)\Pdx)-- <{ \f{x)\Pdx)^ + { \gix)\Pdx)^. 

D J D J D 

Poincare inequality [56] : 

For g e H^{D), 

\\gr= f gHx,y)dxdy<^-^ f |V5prfxdy=^||V.g|p, 

Jd Jd 

where |-D| is the Lebesgue measure of tlic domain D. 

For u G Wq'^{D), 1 < p < oo and D C M" a boimded domain 

Mp < c||Vu||p, 

where C is a positive constant depending only on the domain D. 

Let u G W^'P{D), 1 < p < oo and D C M" a bounded convex domain. Let 
iS* C -D be a measurable subset, and define the spatial average of u over S by 
Zi5 = 1^ udx (here \S\ is the volume or Lebesgue measure of S). Then 

\\u - usWp < C\\Vu\\p, 

where C is a positive constant depending only on the domain D and S. 
Agmon inequality |56| : 

Let D C M" . There exists a constant C depending only on domain D such 
that 

||w||l^(l>) < C||Mp „_i ||up„+i , for n odd, 

H^2-{D) H—{D) 
J. J. 

\\u\\l^(d) < ||w||^„-2 „+2 , for n even. 

In particular, for n = 1 and u G H^(0, 1), 

1 1 

\\u\\l^(0.1) < ^^ll"lll2(o,,) ll"ll|fi(o,i)- 

Moreover, for n = 1 and u G H^{Q, I), 

||w||l-(o,0 ^ C!Mh{aj) ll^^l!!2(o,o- 
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6.3 Stochastic Burgers equation 

We now consider the Burgers equation with additive noise forcing as in [5]: 

dtu + u ■ d^u = i^d^u + aWt (90) 

u(-,0) = 0, u{-,l)=0, m(x,0) = wo(a;), (91) 

where Wt is a Brownian motion, with covariance Q, taking values in the Hilbert 
space -L^(0, Z) with the usual scalar product (•,•). We assume that the trace 
Tr{Q) is finite. So Wt is noise colored in space but white in time. 

Taking F{u) = i u'^dx = \ {u, u) and applying the Ito's formula, we obtain 



]^d\\uf = {u, adWt) + [(it, vu^,, - uu^) + / Tr{Q)]dt. (92) 



Thus 



^E||uf = 2E(u, MW,) + fj^ Z Tr(Q) 

= -2vW\\u^f ^a"^ lTr{Q). (93) 

By the Poincare inequality < c||ui,||^ for some positive constant depending 
only on the interval (0, Z), we have 

^nWf < -—n\uf + I Tr{Q). (94) 
dt c 

Then using the Gronwall inequality, we finally get 

Ellujp < Ejluolpe-^* + a^l Tr{Q)[l - e"^*]. (95) 

Note that the first term in this estimate involves the initial data, and the second 
term involves the noise intensity cr as well as the trace of the noise covariance. 

We finally consider the Burgers equation with multiplicative noise forcing. 

dfU + u ■ dxU — vd^u + auwt, (96) 

with the same boundary condition and initial condition as above, where wt is a 
scalar Brownian motion (e.g., with covariance Q = 1 and the trace Tr{Q) = 1). 
So Wt is noise homogeneous in space but white in time. 
By the Ito's formula, we obtain 

= {u,audwt) + [(w, i/u^a,. ~ uu^) + icr^||u|p]dt. (97) 



Thus 



dt 

= -2i^E\\ux\\'^ + a'^E\\u\\'^ 

< (^a^-^)E\\u\\\ (98) 
c 
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Therefore, 



\u 



r <E||iio!|'e('^'"^^*. (99) 



Note here that the multiphcative noise affects the mean energy growth or 
decay rate, while the additive noise affects the mean energy upper bound. 

6.4 Likelihood for staying bounded 

By the Chebyshev inequahty. we can estimate the hkchhood of solution orbits 
staying inside or outside a bounded domain in Hilbcrt space H ~ L^{0,1). 
Taking the bounded domain as a ball centered at the origin with radius S > 0. 
For example, for the above Burgers equation with multiplicative noise, we have 

P{uj:\\u\\>S) < ^E\\uf 

< *^e(^--)*. (100) 

0^ 



and 



{uj : \\u\\ < S) = 1-V{uj ■.\\u\\>S) 



> 1- " e'^" 101 
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